We used a combined approach based on fragment-based drug design (FBDD) and in silico methods to design potential inhibitors of the cytosolic 5'-nucleotidase II (cN-II), which has been recognized as an important therapeutic target in hematological cancers. Two subgroups of small compounds (including adenine and biaryl moieties) were identified as cN-II binders and a fragment growing strategy guided by molecular docking was considered. Five compounds induced a strong inhibition of the 5'-nucleotidase activity in vitro, and the most potent ones were characterized as noncompetitive inhibitors. Biological evaluation in cancer cell lines showed synergic effect with selected anticancer drugs. Structural studies using X-ray crystallography lead to the identification of new binding sites for two derivatives and of a new crystal form showing important domain swapping. Altogether, the strategy developed herein allowed identifying new original noncompetitive inhibitors against cN-II that act in a synergistic manner with well-known antitumoral agents.